Package-level declarations

Read some input source and produce tokens.

Types

Link copied to clipboard
interface Scanner : Iterator<Token>

This interface represents an input stream of Tokens.

Link copied to clipboard
class ScannerImpl(settings: LoadSettings, reader: StreamReader) : Scanner

Scanner produces tokens of the following types:

Link copied to clipboard
class StreamReader(loadSettings: LoadSettings, stream: Source)

Read the provided stream of code points into String and implement look-ahead operations. Checks if code points are in the allowed range.